Usability of Telehealth Systems for Noncommunicable Diseases in Primary Care From the COVID-19 Pandemic Onward: Systematic Review.

BACKGROUND: During the COVID-19 pandemic, telehealth was expanded without the opportunity to extensively evaluate the adopted technology's usability. OBJECTIVE: We aimed to synthesize evidence on health professionals' perceptions regarding the usability of telehealth systems in the primary care of individuals with noncommunicable diseases (NCDs; hypertension and diabetes) from the COVID-19 pandemic onward. METHODS: A systematic review was performed of clinical trials, prospective cohort studies, retrospective observational studies, and studies that used qualitative data collection and analysis methods published in English, Spanish, and Portuguese from March 2020 onward. The databases queried were MEDLINE, Embase, BIREME, IEEE Xplore, BVS, Google Scholar, and grey literature. Studies involving health professionals who used telehealth systems in primary care and managed patients with NCDs from the COVID-19 pandemic onward were considered eligible. Titles, abstracts, and full texts were reviewed. Data were extracted to provide a narrative qualitative evidence synthesis of the included articles. The risk of bias and methodological quality of the included studies were analyzed. The primary outcome was the usability of telehealth systems, while the secondary outcomes were satisfaction and the contexts in which the telehealth system was used. RESULTS: We included 11 of 417 retrieved studies, which had data from 248 health care professionals. These health care professionals were mostly doctors and nurses with prior experience in telehealth in high- and middle-income countries. Overall, 9 studies (82%) were qualitative studies and 2 (18%) were quasiexperimental or multisite trial studies. Moreover, 7 studies (64%) addressed diabetes, 1 (9%) addressed diabetes and hypertension, and 3 (27%) addressed chronic diseases. Most studies used a survey to assess usability. With a moderate confidence level, we concluded that health professionals considered the usability of telehealth systems to be good and felt comfortable and satisfied. Patients felt satisfied using telehealth. The most important predictor for using digital health technologies was ease of use. The main barriers were technological challenges, connectivity issues, low computer literacy, inability to perform complete physical examination, and lack of training. Although the usability of telehealth systems was considered good, there is a need for research that investigates factors that may influence the perceptions of telehealth usability, such as differences between private and public services; differences in the level of experience of professionals, including professional experience and experience with digital tools; and differences in gender, age groups, occupations, and settings. CONCLUSIONS: The COVID-19 pandemic has generated incredible demand for virtual care. Professionals' favorable perceptions of the usability of telehealth indicate that it can facilitate access to quality care. Although there are still challenges to telehealth, more than infrastructure challenges, the most reported challenges were related to empowering people for digital health. TRIAL REGISTRATION: PROSPERO International Prospective Register of Systematic Reviews CRD42021296887; https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=296887. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.21801/ppcrj.2022.82.6.

Mechanical ventilation and death in pregnant patients admitted for COVID-19: a prognostic analysis from the Brazilian COVID-19 registry score.

BACKGROUND: The assessment of clinical prognosis of pregnant COVID-19 patients at hospital presentation is challenging, due to physiological adaptations during pregnancy. Our aim was to assess the performance of the ABC2-SPH score to predict in-hospital mortality and mechanical ventilation support in pregnant patients with COVID-19, to assess the frequency of adverse pregnancy outcomes, and characteristics of pregnant women who died. METHODS: This multicenter cohort included consecutive pregnant patients with COVID-19 admitted to the participating hospitals, from April/2020 to March/2022. Primary outcomes were in-hospital mortality and the composite outcome of mechanical ventilation support and in-hospital mortality. Secondary endpoints were pregnancy outcomes. The overall discrimination of the model was presented as the area under the receiver operating characteristic curve (AUROC). Overall performance was assessed using the Brier score. RESULTS: From 350 pregnant patients (median age 30 [interquartile range (25.2, 35.0)] years-old]), 11.1% had hypertensive disorders, 19.7% required mechanical ventilation support and 6.0% died. The AUROC for in-hospital mortality and for the composite outcome were 0.809 (95% IC: 0.641-0.944) and 0.704 (95% IC: 0.617-0.792), respectively, with good overall performance (Brier = 0.0384 and 0.1610, respectively). Calibration was good for the prediction of in-hospital mortality, but poor for the composite outcome. Women who died had a median age 4 years-old higher, higher frequency of hypertensive disorders (38.1% vs. 9.4%, p < 0.001) and obesity (28.6% vs. 10.6%, p = 0.025) than those who were discharged alive, and their newborns had lower birth weight (2000 vs. 2813, p = 0.001) and five-minute Apgar score (3.0 vs. 8.0, p < 0.001). CONCLUSIONS: The ABC2-SPH score had good overall performance for in-hospital mortality and the composite outcome mechanical ventilation and in-hospital mortality. Calibration was good for the prediction of in-hospital mortality, but it was poor for the composite outcome. Therefore, the score may be useful to predict in-hospital mortality in pregnant patients with COVID-19, in addition to clinical judgment. Newborns from women who died had lower birth weight and Apgar score than those who were discharged alive.

Synchronous teleconsultation and monitoring service targeting COVID-19: leveraging insights for post-pandemic healthcare.

BACKGROUND: Although a great number of teleconsultation services have been developed during COVID-19 pandemic, studies assessing usability and healthcare provider satisfaction are still incipient. OBJECTIVE: To describe the development, implementation and expansion of a synchronous teleconsultation service targeting patients with symptoms of COVID-19 in Brazil, as well as to assess its usability and healthcare professionals' satisfaction. METHODS: This mixed-methods study was developed in five phases: (i) identification of components, technical and functional requirements and system architecture; (ii) system and user interface development and validation; (iii) pilot testing in the city of Divinópolis; (iv) expansion in the cities of Divinópolis, Teófilo Otoni and Belo Horizonte for Universidade Federal de Minas Gerais faculty and students; (v) usability and satisfaction assessment, using Likert scale and open-ended questions. RESULTS: During pilot development, problems to contact users were solved by introducing standardized text messages (SMS) sent to them to obtain their feedback and keep track of them. Until April, 2022, the expanded system achieved 31,966 patients in 146,158 teleconsultations. Teleconsultations were initiated through chatbot in 27,69% of cases. Teleconsultation efficiency per city was 93.7% in Teófilo Otoni, 92.4% in Divinopolis, and 98.8% in Belo Horizonte (university campus), avoiding in-person assistance for the great majority of patients. 60 healthcare professionals assessed the system's usability as satisfactory, despite a few system instability problems. CONCLUSIONS: The system provided updated information about COVID-19 and enabled remote care for thousands of patients, which evidenced the critical role of telemedicine in expanding emergency services capacity during the pandemic. The dynamic nature of the current pandemic required fast planning, implementation, development and updates in the system. Usability and satisfaction assessment was key to identifying areas for improvement. The experience reported here is expected to inform telemedicine strategies to be implemented in a post-pandemic scenario.

Evaluating User Experience With a Chatbot Designed as a Public Health Response to the COVID-19 Pandemic in Brazil: Mixed Methods Study.

BACKGROUND: The potential of chatbots for screening and monitoring COVID-19 was envisioned since the outbreak of the disease. Chatbots can help disseminate up-to-date and trustworthy information, promote healthy social behavior, and support the provision of health care services safely and at scale. In this scenario and in view of its far-reaching postpandemic impact, it is important to evaluate user experience with this kind of application. OBJECTIVE: We aimed to evaluate the quality of user experience with a COVID-19 chatbot designed by a large telehealth service in Brazil, focusing on the usability of real users and the exploration of strengths and shortcomings of the chatbot, as revealed in reports by participants in simulated scenarios. METHODS: We examined a chatbot developed by a multidisciplinary team and used it as a component within the workflow of a local public health care service. The chatbot had 2 core functionalities: assisting web-based screening of COVID-19 symptom severity and providing evidence-based information to the population. From October 2020 to January 2021, we conducted a mixed methods approach and performed a 2-fold evaluation of user experience with our chatbot by following 2 methods: a posttask usability Likert-scale survey presented to all users after concluding their interaction with the bot and an interview with volunteer participants who engaged in a simulated interaction with the bot guided by the interviewer. RESULTS: Usability assessment with 63 users revealed very good scores for chatbot usefulness (4.57), likelihood of being recommended (4.48), ease of use (4.44), and user satisfaction (4.38). Interviews with 15 volunteers provided insights into the strengths and shortcomings of our bot. Comments on the positive aspects and problems reported by users were analyzed in terms of recurrent themes. We identified 6 positive aspects and 15 issues organized in 2 categories: usability of the chatbot and health support offered by it, the former referring to usability of the chatbot and how users can interact with it and the latter referring to the chatbot's goal in supporting people during the pandemic through the screening process and education to users through informative content. We found 6 themes accounting for what people liked most about our chatbot and why they found it useful-3 themes pertaining to the usability domain and 3 themes regarding health support. Our findings also identified 15 types of problems producing a negative impact on users-10 of them related to the usability of the chatbot and 5 related to the health support it provides. CONCLUSIONS: Our results indicate that users had an overall positive experience with the chatbot and found the health support relevant. Nonetheless, qualitative evaluation of the chatbot indicated challenges and directions to be pursued in improving not only our COVID-19 chatbot but also health chatbots in general.

COVID-19: Distance learning to empower educators and health assistants in rural areas.

BACKGROUND: Educators and health assistants can act as key players in controlling the pandemic. In general, they are respected by the community, especially in rural areas, and can help guide and raise the population's awareness of preventive measures. The objective of this paper is to evaluate the results in knowledge progress of an e-learning course offered to educators and health assistants by a public university and to analyze the profile and satisfaction of the participants. MATERIALS AND METHODS: A single group pre- and post-test design based on a questionnaire, interventional, study was conducted in the period from April 20th to June 20th. All participants of the course answered sociodemographic and satisfaction questionnaire and a pre- and post-test. Data were descriptively arranged and regarding the distribution and comparison of means and frequency, paired t-test for group comparisons. P < 0.05 was statistically significant. Data were collected from the Moodle® teaching platform, without identifying the participants. RESULTS: A total of 674 participants were enrolled in the five groups, and 583 concluded the course (86.5%). The reasons for those who did not access the entire course (n = 47) were: Lack of time, difficulty in accessing the internet, and lack of experience with distance learning courses. On the evaluation of the course platform, from the tutors in general and the degree of satisfaction in several questions, participants marked maximum grades. The comparison between pre- and post-proficiency scores showed increased proficiency of the enrolled groups (P < 0.0001). CONCLUSIONS: The course contributed to the training of health assistants and educators, preparing them to act in a participatory way in the prevention and control of the pandemic. The course was well evaluated and there was a progression of knowledge by the participants.

A Mobile Serious Game About the Pandemic (COVID-19 - Did You Know?): Design and Evaluation Study.

BACKGROUND: No treatment for COVID-19 is yet available; therefore, providing access to information about SARS-CoV-2, the transmission route of the virus, and ways to prevent the spread of infection is a critical sanitary measure worldwide. Serious games have advantages in the dissemination of reliable information during the pandemic; they can provide qualified content while offering interactivity to the user, and they have great reach over the internet. OBJECTIVE: This study aimed to develop a serious game with the purpose of providing science-based information on the prevention of COVID-19 and personal care during the pandemic while assessing players' knowledge about COVID-19-related topics. METHODS: The study was conducted with the interdisciplinary collaboration of specialists in health sciences, computing, and design at the Federal University of Minas Gerais, Brazil. The health recommendations were grouped into six thematic blocks, presented in a quiz format. The software languages were based on the progressive web app development methodology with the Ionic framework, JavaScript, HTML5, cascading style sheets, and TypeScript (Angular). Open data reports of how users interact with the serious game were obtained using the Google Analytics application programming interface. The visual identity, logo, infographics, and icons were carefully developed by considering a selection of colors, typography, sounds, and images that are suitable for young audiences. Cards with cartoon characters were introduced at the end of each thematic topic to interact with the player, reinforcing their correct answers or alerting them to the need to learn more about the disease. The players' performance was assessed by the rate of incorrect and correct answers and analyzed by linear correlation coefficient over 7 weeks. The agile SCRUM development methodology enabled quick and daily interactions of developers through a webchat and sequential team meetings. RESULTS: The game "COVID-19-Did You Know?" was made available for free on a public university website on April 1, 2020. The game had been accessed 17,571 times as of September 2020. Dissemination actions such as reports on social media and television showed a temporal correspondence with the access number. The players' error rate in the topic "Mask" showed a negative trend (r=-.83; P=.01) over the weeks of follow-up. The other topics showed no significant trend over the weeks. CONCLUSIONS: The gamification strategy for health education content on the theme of COVID-19 reached a young audience, which is considered to be a priority in the strategy of orientation toward social distancing. Specific educational reinforcement measures were proposed and implemented based on the players' performance. The improvement in the users' performance on the topic about the use of masks may reflect an increase in information about or adherence to mask use over time.